Pandas Profiling Report

Dataset statistics

Number of variables	13
Number of observations	2969
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	301.7 KiB
Average record size in memory	104.0 B

Variable types

Numeric	13

Warnings

`gross_revenue` is highly correlated with `qtde_items`	High correlation
`qtde_items` is highly correlated with `gross_revenue`	High correlation
`avg_ticket` is highly correlated with `qtde_returns` and 1 other fields	High correlation
`qtde_returns` is highly correlated with `avg_ticket` and 1 other fields	High correlation
`avg_basket_size` is highly correlated with `avg_ticket` and 1 other fields	High correlation
`avg_ticket` is highly skewed (γ1 = 53.44422362)	Skewed
`frequency` is highly skewed (γ1 = 24.88049136)	Skewed
`qtde_returns` is highly skewed (γ1 = 51.79774426)	Skewed
`avg_basket_size` is highly skewed (γ1 = 44.67271661)	Skewed
`df_index` has unique values	Unique
`customer_id` has unique values	Unique
`avg_ticket` has unique values	Unique
`recency_days` has 34 (1.1%) zeros	Zeros
`qtde_returns` has 1481 (49.9%) zeros	Zeros

Reproduction

Analysis started	2021-05-25 23:28:07.712569
Analysis finished	2021-05-25 23:28:36.570539
Duration	28.86 seconds
Software version	pandas-profiling v2.13.0
Download configuration	config.yaml

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	2969
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2317.292354

Minimum	0
Maximum	5715
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	0
5-th percentile	185.4
Q1	929
median	2120
Q3	3537
95-th percentile	5035.2
Maximum	5715
Range	5715
Interquartile range (IQR)	2608

Descriptive statistics

Standard deviation	1554.944589
Coefficient of variation (CV)	0.6710178739
Kurtosis	-1.010787014
Mean	2317.292354
Median Absolute Deviation (MAD)	1271
Skewness	0.342284058
Sum	6880041
Variance	2417852.674
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
2654	1	< 0.1%
2644	1	< 0.1%
597	1	< 0.1%
2646	1	< 0.1%
599	1	< 0.1%
2648	1	< 0.1%
601	1	< 0.1%
603	1	< 0.1%
5144	1	< 0.1%
Other values (2959)	2959	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%

Value	Count	Frequency (%)
5715	1	< 0.1%
5696	1	< 0.1%
5686	1	< 0.1%
5680	1	< 0.1%
5659	1	< 0.1%

customer_id
Real number (ℝ_≥0)

UNIQUE

Distinct	2969
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15270.77299

Minimum	12347
Maximum	18287
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	12347
5-th percentile	12619.4
Q1	13799
median	15221
Q3	16768
95-th percentile	17964.6
Maximum	18287
Range	5940
Interquartile range (IQR)	2969

Descriptive statistics

Standard deviation	1718.990292
Coefficient of variation (CV)	0.1125673398
Kurtosis	-1.206094692
Mean	15270.77299
Median Absolute Deviation (MAD)	1488
Skewness	0.03160785866
Sum	45338925
Variance	2954927.624
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
16384	1	< 0.1%
18164	1	< 0.1%
12933	1	< 0.1%
12935	1	< 0.1%
14984	1	< 0.1%
17033	1	< 0.1%
13704	1	< 0.1%
12939	1	< 0.1%
17037	1	< 0.1%
14125	1	< 0.1%
Other values (2959)	2959	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
12347	1	< 0.1%
12348	1	< 0.1%
12352	1	< 0.1%
12356	1	< 0.1%
12358	1	< 0.1%

Value	Count	Frequency (%)
18287	1	< 0.1%
18283	1	< 0.1%
18282	1	< 0.1%
18277	1	< 0.1%
18276	1	< 0.1%

gross_revenue
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	2963
Distinct (%)	99.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2749.321711

Minimum	6.2
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	6.2
5-th percentile	229.77
Q1	570.96
median	1086.92
Q3	2308.06
95-th percentile	7219.68
Maximum	279138.02
Range	279131.82
Interquartile range (IQR)	1737.1

Descriptive statistics

Standard deviation	10580.62331
Coefficient of variation (CV)	3.848448607
Kurtosis	353.944724
Mean	2749.321711
Median Absolute Deviation (MAD)	672.16
Skewness	16.77755612
Sum	8162736.16
Variance	111949589.6
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
379.65	2	0.1%
533.33	2	0.1%
745.06	2	0.1%
734.94	2	0.1%
731.9	2	0.1%
331	2	0.1%
719.78	1	< 0.1%
13375.87	1	< 0.1%
447.64	1	< 0.1%
567.36	1	< 0.1%
Other values (2953)	2953	99.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
6.2	1	< 0.1%
13.3	1	< 0.1%
15	1	< 0.1%
36.56	1	< 0.1%
45	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
168472.5	1	< 0.1%
140450.72	1	< 0.1%

recency_days
Real number (ℝ_≥0)

ZEROS

Distinct	272
Distinct (%)	9.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	64.28763894

Minimum	0
Maximum	373
Zeros	34
Zeros (%)	1.1%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	11
median	31
Q3	81
95-th percentile	242
Maximum	373
Range	373
Interquartile range (IQR)	70

Descriptive statistics

Standard deviation	77.75677911
Coefficient of variation (CV)	1.209513686
Kurtosis	2.777962659
Mean	64.28763894
Median Absolute Deviation (MAD)	26
Skewness	1.798379538
Sum	190870
Variance	6046.116697
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	99	3.3%
4	87	2.9%
2	85	2.9%
3	85	2.9%
8	76	2.6%
10	67	2.3%
9	66	2.2%
7	66	2.2%
17	64	2.2%
16	55	1.9%
Other values (262)	2219	74.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	34	1.1%
1	99	3.3%
2	85	2.9%
3	85	2.9%
4	87	2.9%

Value	Count	Frequency (%)
373	2	0.1%
372	4	0.1%
371	1	< 0.1%
368	1	< 0.1%
366	4	0.1%

qtde_invoices
Real number (ℝ_≥0)

Distinct	56
Distinct (%)	1.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.723139104

Minimum	1
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	6
95-th percentile	17
Maximum	206
Range	205
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	8.85653132
Coefficient of variation (CV)	1.547495379
Kurtosis	190.8344494
Mean	5.723139104
Median Absolute Deviation (MAD)	2
Skewness	10.76680458
Sum	16992
Variance	78.43814702
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2	785	26.4%
3	499	16.8%
4	393	13.2%
5	237	8.0%
1	190	6.4%
6	173	5.8%
7	138	4.6%
8	98	3.3%
9	69	2.3%
10	55	1.9%
Other values (46)	332	11.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	190	6.4%
2	785	26.4%
3	499	16.8%
4	393	13.2%
5	237	8.0%

Value	Count	Frequency (%)
206	1	< 0.1%
199	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	0.1%

qtde_items
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1671
Distinct (%)	56.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1608.852476

Minimum	1
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	102.4
Q1	296
median	641
Q3	1401
95-th percentile	4407.4
Maximum	196844
Range	196843
Interquartile range (IQR)	1105

Descriptive statistics

Standard deviation	5887.578045
Coefficient of variation (CV)	3.659489067
Kurtosis	465.998084
Mean	1608.852476
Median Absolute Deviation (MAD)	422
Skewness	17.85859125
Sum	4776683
Variance	34663575.24
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
310	11	0.4%
88	9	0.3%
150	9	0.3%
288	8	0.3%
272	8	0.3%
84	8	0.3%
246	8	0.3%
260	8	0.3%
493	7	0.2%
134	7	0.2%
Other values (1661)	2886	97.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1	< 0.1%
2	2	0.1%
12	2	0.1%
16	1	< 0.1%
17	1	< 0.1%

Value	Count	Frequency (%)
196844	1	< 0.1%
80997	1	< 0.1%
80263	1	< 0.1%
77373	1	< 0.1%
69993	1	< 0.1%

qtde_products
Real number (ℝ_≥0)

Distinct	468
Distinct (%)	15.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	122.7241495

Minimum	1
Maximum	7838
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	9
Q1	29
median	67
Q3	135
95-th percentile	382
Maximum	7838
Range	7837
Interquartile range (IQR)	106

Descriptive statistics

Standard deviation	269.8964081
Coefficient of variation (CV)	2.199211884
Kurtosis	354.8611303
Mean	122.7241495
Median Absolute Deviation (MAD)	44
Skewness	15.70763473
Sum	364368
Variance	72844.07112
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
28	43	1.4%
20	37	1.2%
35	35	1.2%
29	35	1.2%
19	34	1.1%
15	33	1.1%
11	32	1.1%
26	31	1.0%
27	30	1.0%
25	30	1.0%
Other values (458)	2629	88.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	6	0.2%
2	14	0.5%
3	16	0.5%
4	17	0.6%
5	26	0.9%

Value	Count	Frequency (%)
7838	1	< 0.1%
5673	1	< 0.1%
5095	1	< 0.1%
4580	1	< 0.1%
2698	1	< 0.1%

avg_ticket
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
UNIQUE

Distinct	2969
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	51.89776151

Minimum	2.150588235
Maximum	56157.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	2.150588235
5-th percentile	4.916661099
Q1	13.11933333
median	17.95658654
Q3	24.98828571
95-th percentile	90.497
Maximum	56157.5
Range	56155.34941
Interquartile range (IQR)	11.86895238

Descriptive statistics

Standard deviation	1036.934407
Coefficient of variation (CV)	19.98033011
Kurtosis	2890.707126
Mean	51.89776151
Median Absolute Deviation (MAD)	5.984842033
Skewness	53.44422362
Sum	154084.4539
Variance	1075232.964
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17.49275862	1	< 0.1%
15.41363636	1	< 0.1%
18.15061538	1	< 0.1%
17.94344444	1	< 0.1%
43.2192	1	< 0.1%
33.53571429	1	< 0.1%
9.418292683	1	< 0.1%
19.55767045	1	< 0.1%
132.0738983	1	< 0.1%
16.80722222	1	< 0.1%
Other values (2959)	2959	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2.150588235	1	< 0.1%
2.4325	1	< 0.1%
2.462371134	1	< 0.1%
2.511241379	1	< 0.1%
2.515333333	1	< 0.1%

Value	Count	Frequency (%)
56157.5	1	< 0.1%
4453.43	1	< 0.1%
3202.92	1	< 0.1%
1687.2	1	< 0.1%
952.9875	1	< 0.1%

avg_recency_days
Real number (ℝ_≥0)

Distinct	1258
Distinct (%)	42.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	67.34851138

Minimum	1
Maximum	366
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	8
Q1	25.92307692
median	48.28571429
Q3	85.33333333
95-th percentile	201
Maximum	366
Range	365
Interquartile range (IQR)	59.41025641

Descriptive statistics

Standard deviation	63.54492876
Coefficient of variation (CV)	0.9435238799
Kurtosis	4.887109087
Mean	67.34851138
Median Absolute Deviation (MAD)	26.28571429
Skewness	2.062770925
Sum	199957.7303
Variance	4037.957972
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
14	25	0.8%
4	22	0.7%
70	21	0.7%
7	20	0.7%
35	19	0.6%
49	18	0.6%
21	17	0.6%
46	17	0.6%
11	17	0.6%
5	16	0.5%
Other values (1248)	2777	93.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	16	0.5%
1.5	1	< 0.1%
2	13	0.4%
2.5	1	< 0.1%
2.601398601	1	< 0.1%

Value	Count	Frequency (%)
366	1	< 0.1%
365	1	< 0.1%
363	1	< 0.1%
362	1	< 0.1%
357	2	0.1%

frequency
Real number (ℝ_≥0)

SKEWED

Distinct	1225
Distinct (%)	41.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.1137973039

Minimum	0.005449591281
Maximum	17
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	0.005449591281
5-th percentile	0.008894164194
Q1	0.01633986928
median	0.02588996764
Q3	0.04945054945
95-th percentile	1
Maximum	17
Range	16.99455041
Interquartile range (IQR)	0.03311068017

Descriptive statistics

Standard deviation	0.4081562524
Coefficient of variation (CV)	3.586695275
Kurtosis	989.3650758
Mean	0.1137973039
Median Absolute Deviation (MAD)	0.0121913375
Skewness	24.88049136
Sum	337.8641954
Variance	0.1665915263
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	198	6.7%
0.0625	18	0.6%
0.02777777778	17	0.6%
0.02380952381	16	0.5%
0.08333333333	15	0.5%
0.09090909091	15	0.5%
0.03448275862	14	0.5%
0.02941176471	14	0.5%
0.03571428571	13	0.4%
0.02564102564	13	0.4%
Other values (1215)	2636	88.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005479452055	1	< 0.1%
0.005494505495	1	< 0.1%
0.005586592179	2	0.1%

Value	Count	Frequency (%)
17	1	< 0.1%
3	1	< 0.1%
2	6	0.2%
1.142857143	1	< 0.1%
1	198	6.7%

qtde_returns
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	214
Distinct (%)	7.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	62.1569552

Minimum	0
Maximum	80995
Zeros	1481
Zeros (%)	49.9%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	9
95-th percentile	100.6
Maximum	80995
Range	80995
Interquartile range (IQR)	9

Descriptive statistics

Standard deviation	1512.496135
Coefficient of variation (CV)	24.33349783
Kurtosis	2765.52864
Mean	62.1569552
Median Absolute Deviation (MAD)	1
Skewness	51.79774426
Sum	184544
Variance	2287644.557
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1481	49.9%
1	164	5.5%
2	148	5.0%
3	105	3.5%
4	89	3.0%
6	78	2.6%
5	61	2.1%
12	51	1.7%
7	43	1.4%
8	43	1.4%
Other values (204)	706	23.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1481	49.9%
1	164	5.5%
2	148	5.0%
3	105	3.5%
4	89	3.0%

Value	Count	Frequency (%)
80995	1	< 0.1%
9014	1	< 0.1%
8004	1	< 0.1%
4427	1	< 0.1%
3768	1	< 0.1%

avg_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	1979
Distinct (%)	66.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	249.8137641

Minimum	1
Maximum	40498.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	44
Q1	103.25
median	172.3333333
Q3	281.6923077
95-th percentile	600
Maximum	40498.5
Range	40497.5
Interquartile range (IQR)	178.4423077

Descriptive statistics

Standard deviation	791.5551894
Coefficient of variation (CV)	3.168581172
Kurtosis	2255.538236
Mean	249.8137641
Median Absolute Deviation (MAD)	83.08333333
Skewness	44.67271661
Sum	741697.0657
Variance	626559.6179
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	11	0.4%
114	10	0.3%
82	9	0.3%
73	9	0.3%
86	9	0.3%
136	8	0.3%
75	8	0.3%
88	8	0.3%
60	8	0.3%
163	7	0.2%
Other values (1969)	2882	97.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2	0.1%
2	1	< 0.1%
3.333333333	1	< 0.1%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%

Value	Count	Frequency (%)
40498.5	1	< 0.1%
6009.333333	1	< 0.1%
4282	1	< 0.1%
3906	1	< 0.1%
3868.65	1	< 0.1%

avg_unique_basket_size
Real number (ℝ_≥0)

Distinct	1005
Distinct (%)	33.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	22.1547082

Minimum	1
Maximum	299.7058824
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	3.345454545
Q1	10
median	17.2
Q3	27.75
95-th percentile	56.94
Maximum	299.7058824
Range	298.7058824
Interquartile range (IQR)	17.75

Descriptive statistics

Standard deviation	19.51232207
Coefficient of variation (CV)	0.8807302672
Kurtosis	27.70329723
Mean	22.1547082
Median Absolute Deviation (MAD)	8.2
Skewness	3.499455899
Sum	65777.32865
Variance	380.7307127
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
13	53	1.8%
14	39	1.3%
11	38	1.3%
20	33	1.1%
9	33	1.1%
1	32	1.1%
17	31	1.0%
10	30	1.0%
18	30	1.0%
16	29	1.0%
Other values (995)	2621	88.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	32	1.1%
1.2	1	< 0.1%
1.25	1	< 0.1%
1.333333333	2	0.1%
1.5	8	0.3%

Value	Count	Frequency (%)
299.7058824	1	< 0.1%
259	1	< 0.1%
203.5	1	< 0.1%
148	1	< 0.1%
145	1	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	df_index	customer_id	gross_revenue	recency_days	qtde_invoices	qtde_items	qtde_products	avg_ticket	avg_recency_days	frequency	qtde_returns	avg_basket_size	avg_unique_basket_size
0	0	17850	5391.21	372.0	34.0	1733.0	297.0	18.152222	35.500000	17.000000	40.0	50.970588	8.735294
1	1	13047	3232.59	56.0	9.0	1390.0	171.0	18.904035	27.250000	0.028302	35.0	154.444444	19.000000
2	2	12583	6705.38	2.0	15.0	5028.0	232.0	28.902500	23.187500	0.040323	50.0	335.200000	15.466667
3	3	13748	948.25	95.0	5.0	439.0	28.0	33.866071	92.666667	0.017921	0.0	87.800000	5.600000
4	4	15100	876.00	333.0	3.0	80.0	3.0	292.000000	8.600000	0.073171	22.0	26.666667	1.000000
5	5	15291	4623.30	25.0	14.0	2102.0	102.0	45.326471	23.200000	0.040115	29.0	150.142857	7.285714
6	6	14688	5630.87	7.0	21.0	3621.0	327.0	17.219786	18.300000	0.057221	399.0	172.428571	15.571429
7	7	17809	5411.91	16.0	12.0	2057.0	61.0	88.719836	35.700000	0.033520	41.0	171.416667	5.083333
8	8	15311	60767.90	0.0	91.0	38194.0	2379.0	25.543464	4.144444	0.243316	474.0	419.714286	26.142857
9	9	16098	2005.63	87.0	7.0	613.0	67.0	29.934776	47.666667	0.024390	0.0	87.571429	9.571429

Last rows

	df_index	customer_id	gross_revenue	recency_days	qtde_invoices	qtde_items	qtde_products	avg_ticket	avg_recency_days	frequency	qtde_returns	avg_basket_size	avg_unique_basket_size
2959	5627	17727	1060.25	15.0	1.0	645.0	66.0	16.064394	6.0	1.000000	6.0	645.000000	66.0
2960	5637	17232	421.52	2.0	2.0	203.0	36.0	11.708889	12.0	0.153846	0.0	101.500000	18.0
2961	5638	17468	137.00	10.0	2.0	116.0	5.0	27.400000	4.0	0.400000	0.0	58.000000	2.5
2962	5649	13596	697.04	5.0	2.0	406.0	166.0	4.199036	7.0	0.250000	0.0	203.000000	83.0
2963	5655	14893	1237.85	9.0	2.0	799.0	73.0	16.956849	2.0	0.666667	0.0	399.500000	36.5
2964	5659	12479	473.20	11.0	1.0	382.0	30.0	15.773333	4.0	1.000000	34.0	382.000000	30.0
2965	5680	14126	706.13	7.0	3.0	508.0	15.0	47.075333	3.0	0.750000	50.0	169.333333	5.0
2966	5686	13521	1092.39	1.0	3.0	733.0	435.0	2.511241	4.5	0.300000	0.0	244.333333	145.0
2967	5696	15060	301.84	8.0	4.0	262.0	120.0	2.515333	1.0	2.000000	0.0	65.500000	30.0
2968	5715	12558	269.96	7.0	1.0	196.0	11.0	24.541818	6.0	1.000000	196.0	196.000000	11.0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows